5 What is claimed is; 

1 . \ A method of using a system with at least one of audio, image, and a 

\ video comprising a plurality of frames comprising the steps of: 
(a) providing at least two of the following: 

(i)\ a program description scheme containing information related 
10 \ to at least one of information regarding interrelationships 

between a plurality of said frames, characteristics of the 
content of a plurality of said frames, characteristics of the 
content of said audio, characteristics of the content of said 
image\characteristics of ith^ontent^of smdvideo; 
1 5 (ii) a user description scheme cpdmining information related to 

at least one of a user's personal preferences, information 
related to sain user, a user's viewing history, and a user's 
listening historj/; 
(iii) a system description scheme containing information 
20 regarding at least one of available videos, available 

categories, availabl^hannels, available users, available 
images, capabilities of a device for providing said at least 



one of said audio, said ii^age, and said video to a user, 
relationship between at least two of said video, said program 



25 description scheme, and said user description scheme, 

relationship between at least two of said audio, said program 



-65- 



iescription scheme, and said user description scheme, 
relationship between at least two of said image, said program 
desofiption^cheme, and said user description scheme; and 
selecting at l^st (?iln©^f a video, an image, and audio based upon 
said at least two of s^id program description scheme, said user 
description schemfe, and said system description scheme. 

The method of claim 1 wherein said program description scheme 
V contains information related to said interrelationships of said 
plurality of said frames. 



The method of claim 2 wherein said interrelationships include the 
identification of key frames of said video. 




The method oi\claim 2 wherein said interrelationships include the 
identification of a^lurality of said frames representative of the 
highlights of at least a portion of said video. 



The method of claim 2 wherein said interrelationships include the 
identification of a set of frames, each of which is representative of a 
different portion of said videk 
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The method of claim 5 wherein said different portion of said video is 
non-overlapping. 



10 



The method of claim zVwherein said interrelationships include the 
identification of a pluralky of sequential frames of said video that 
represent at least one of a shot and a scene. 



8. The method of claim 7 wherein said identification further includes a 
plurality of said at least one of said shot and said scene. 



15 



9. The method of claim 4 wherein said interrelationships includes a 
plurality of highlights of the same portion of said video having 
different durations. 



20 



10. The method of claim 3 wherein said interrelationships includes a 
plurality of key frames of the same portion oY said video having a 
different number of frames of said portion of said video. 



25 



1 1 . The method of claim 1 wherein said program description scheme 
contains characteristics of said content of said plurality^ of said 
frames. 
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12. The method of claim 1 1 wherein said characteristics include at least 
one of an aqtor within said video, and a classification of the genre of 
said video. 




13. The method of claim 1 1 wherein said characteristics include at least 
one of a color profile of at least a portion of said video, a texture 
profile of at least ^portion of said video, a shape profile of at least a 
portion of said vide\ and a motion profile of at least a portion of 
said video. 



14. The method of claim 1 wherein said program description scheme 

identifies a portion of eac^f a plurality of said fi-ames of said video 
that is to be presented to a us^ at a size larger than it would have 
been presented within said video. 



15. The method of claim 1 wherein said program description scheme 
identifies a second video segment separate fi*om said video that 
includes a close up view of a portion of said video. 



16. The method of claim 1 wherein said program description scheme 

identifies a second audio track separate fron^the normal audio track 
of said video. 
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The method of claim 1 wherein said program description scheme 
includes textual annotation related to said video. 

The method ^claim 17 wherein said textual armotation is related to 
an object withimsaid video. 

The method of claim 18 wherein said object is an actor within said 
video. 



The method of claim 1 wherein said program description scheme 
identifies Internet based information related to said video. 
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